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Foreword by the Minister of Education 

The Seventh Report of the Seconda^ School Examinations 
Council, which I am pleased to be publishing on their behalf, marks 
a significant stage in the development of examinations policy. In 
recommending a move away from the traditional concept of a 
school leaving examination which pupils can only pass or fail the 
Council recognise that they are inviting teachers, parents and 
employers, as well as the public at lai^e, to modify habits of thought 
and attitudes of mind which are widely held. Nevertheless I share 
the Council’s view that the Certificate of Secondary Mucation 
examinations have a broad educational aim, and a wide social 
purpose, and 'that for this and the other reasons which are set out 
with great clarity in the Report a new approach is needed. 

All of us who are concerned with the development of secondary 
education owe a debt of gratitude to Sir John Lockwood and his 
colleagues for the effort and skill with which the Report has been 
compiled. I am confident that the Report will be studied with 
the care which it merits. 

Edward Boyle. 



Ministry of Education. 
August, 1963. 
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Letter from the Chairman to the Minister of Education 



nth My, 1963. 

My Dear Minister, 

I have pleasure in submittiing the Seventh Report of the Secondary School 
Examinations Council. 

In their Fifth Report the Council suggested that a further task for the 
Certificate of Secondary Education Standing Cominititee should be a study 
of the nature and content of the examinations for the Certificate of 
Secondary Education. In their consideration of these questions the Standing 
Committee isolated the scope and stand'ards of the examinations as the two 
principal issues on which the new regional examining boards would be 
likely to need guidance in the ^initial stages of their work. The Standing 
Committee have ‘been able to confirm the view expressed in the Report of 
the Sub-Committee of the Council published in 1960 that the examinations 
should be designed for a band of candidates spanning approximately the 
80th to the 40th percentile of general abiliity. On the subject of the standards 
of the examinations the Standing Committee found it necessary to re-examine 
from first principles the traditional method of defining the standard of a 
school leaving examination by reference to a single pass /fail point. Their 
recommendations, which involve moving towards a new and broader concept 
of the purposes of such examinations, were agreed unanimously, and have 
now been adopted by the Council as their Seventh Report. 

I am confident that the publication of ithis Report will stimulate debate 
about .the nature and purposes of school leaving examinations generally, 
and that this debate will 'be ithe more valuable for the clanity and boldness 
with which the Standing Committee have defined the essential issues. 

Yours sincerely, 

John Lockwood. 



The Right Hon. Sir Blward Boyle, Bt., M J. 
Minister of Education. 
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to attempt (though not necessarily to pass) G.C.E. ‘ O ’ level in a fair 
range of subjects, say four or more. We think that candidates in the 
next 20 per cent, of the age group might take the examinations in a 
fair spread of subjects, say four or five (unless they were simultaneously 
attempting particular subjects in the (3.C.E.), and that the standard 
of the papers set and the marking should be such that a substantial 
majority of pupils within this group might expect, without undue 
pressure, to obtain passes in this range of subjects. We think that 
candidates within a range up to about the next 20 per cent, of the 
age group, who are those round about the average of ability, might 
attempt, and often secure passes in, fewer subjects. We do not of 
course wish to suggest that the proportion awarded passes, and therefore 
the pELSS mark, should be determined on hard-and-fast statistical lines. 
We foresee that much experiment will be needed before appropriate 
standards can be defined, and that even then variation must be expected 
between one subject and another.” 

5. We subjected these statements to a rigorous re-examination, asking our- 
selves three main questions : 

(а) Would a system of subject examinations so constructed be educa- 
tionally sound? 

(б) Would such a system be teohnically feasible? 

(c) How could the pass/fail point in such a system best he defined? 

6. We found it easy to conclude that the examinations system contemplated 
by the Beloe Committee would he educationally sound. In this context, 
the major consideration is the relationship between curriculum and examina- 
tion. The relationship will be most exact when the examinations duplicate, 
as nearly as may be, the recent school work of the candidates. It will he 
least exact when they include questions or tasks which the ablest pupils 
can perform almost without thinking (since the relevant knowledge has 
•long since become part of their basic stock in trade) and others which 
require knowledge well beyond the reach of the weakest candidates. 

7. In practice, the relationship can never be exact. The gradual shading 
of levels of abUity within ithe schools, variations in curricular and organisa- 
tional patterns both within and between the schools, dilierences between 
subjects, variations in the quality of the teaching and consequently in the 
pupils’ response to exposure to a given area of knowledge and deficienoies 
in examining techniques are amongst ithe factors which make it impraoticable 
to secure an exact match between curriculum and examination. But the 
fact remains that some conclusion must be reached as to the relationship that 
is desired, or the examining boards 'wUl be left in doubt as to the width 
of the hand of candidates for whom the exammations should be designed. 

8. It is, however, important to establish precisely what we have in mind 
when we refer to the relationship between examinations and curriculum. We 
do not mean a relationship wi‘th the curriculum as a whole, since this would 
involve providing a group examination. And even when this possibility was 
under discussion, there was never any suggestion that the group should 
include ah the subjects in the curriculum. In fact, the relationship wUl 

2 



Printed image digitised by the University of Southampton Library Digitisation Unit 



not extend over the curriculum as a whole, but should be established subject 
bv subject : puphs will be free to select for exammation purposes those 
subjects where the .relationship between the examination and the work mey 
have been doing in school is reasonably close, or could be m^e so eatto 
by educationally sound modifications of their work m school, or by 
acceptable modifications of the examination itself. Indeed, it was with these 
considerations in mind, amongst others, that we laid ^ress m our last r^ort 
to the Council on the need to aeate opportunities for schools to conduct 
their own C.S.E. examinations, subject to external vahdation. and on the 
need for continuing research and development to make possible constant local 
adjustments of the relationship between subject courses and exammation. 

9 The test we appUed to the educational vahifity of the statements in psua- 
<^aoh 111 of the Beloe Report was therefore 'this; with a system of subjret 
examinations so constructed, would there be a reasonably close relation^p 
between subject course and examination over the range of candidates wtach 
the Beloe Committee had in mind? We noted that the Beloe Comimttee 
had in mind a band of candidates extending from, and includimg, those 
for whom the C.S.E. examinations would be an alternative to the ordmary 
level of the G.C.E. exammation, 'to 'those who are a little below average 
in ability. And we also noted that this band of candidates would be likely, 
in most schools, to be Mowing similar courses in most, 'though not neces- 
sarily in ah, the subjects of the curriculum. Finally, we noted that most 
schools consider that it would be difficult to construct a curriculum and 
subject courses within it, that would meat the need.s of pupils of lesser 
ability if any considerable number of such pupils had to te prepared M 
public examinations of (the type envisaged by the Beloe Comimttee. A^rd- 
ffielv we see no case for either extending or narrowing the sc^ of the 
exan^ations : .the band of candidates recommended by the Bdoe Committee 
is educationally sound. 



10 Nor did we find it difficult to conclude that it would be technically feasible 
to 'construct an examinations system for this band of candidates, wffich would 
produce a pattern of results 'similar to iMt envi^ged by the Beloe Committee. 
In this context, we considered two main questions : 



(a) would it be possible, over the band of candidates just defined, to 
design examinations which, while preserving the desired relationship 
between curriculum and examination, had incentive value for the 
abler pupils, without in the process setting an impossible target at 
the lower end of the band? 



(b) Would the likely correlation between subjects in the C.S.E. examina- 
tions be such as to confirm the pattern of results predicted by the 
Beloe Committee? 



11 . On the first of these two questions we noted that there is no technical 
difficulty about designing examinations which wUl grade the performance of 
secondary school candidates over any band of ability (or attainment) that 



• This is not to say that distortion of educational needs would be involved for all such pupils 
in all subjects. Some pupils of lesser general ability will have abihty m a particular subject 
which brings them within the C.S.E, band for that subject. 
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may be chosen. The difficulty is rather that tests designed to grade perform- 
ances over a wide band of pupils cannot preserve a close relationship between 
the examination and the work which the candidates have been doing in school. 
We have, however,^ already established that pupils within the band which we 
have in mind are likely to be following similar courses in school. It follows 
that there is unlikely to be any serious difficulty about designing examinations 
which would be appropriate for the whole band of candidates, though we 
recognise that the difficulties will be greater in some subjects than in others. 
(For example, at the two ends of the band we have defined there may be 
appreciable differences in some schools in the approach to the teaching of 
science, ranging from distinct courses in the main branches of the subject 
to a single course in general science. We consider, however, that these 
problems can be met through the provision of alternative syllabuses and 
papers, whether by the examining boards themselves or by individual schools 
or groups of schools.) Finally, we noted that the band of candidates con- 
cerned (spanning roughly the 80th to the 40th percentile of general ability) 
covers much the same range of general ability, though potentially a much 
larger number of candidates, than that for which the ordinary level of the 
G.C.E. examination is designed : it should therefore be no more difficult than 
with the G.C.E. examinations to design examinations which are appropriate 
over the whole of the C.S.E. band. This is apparent from the normal curve 
of distribution of ability, as shown in the diagram below. 



DIAGRAM OFTHE NORMAL CURVE OF DISTRIBUTION OF ABILITY 




APPBOXIMATE C.C.E. BAND 



APP80XIHATE C.S.E.BAND 




STANDARDS OF PERFORMANCE 



10 20 30 40 50 60 70 SO 90fh PERCENTILES 



Diagram 1 
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12 . On the second question, we consulted various authorities, who agreed 
that the maximum average correlation* between subjects in the C.S.E. ex- 
aminations was likely to be of the order of 0.8. Using this figure, the 
Curriculum Study Group worked out for us the pattern of results that might 
be expected throughout the C.S.E. band of candidates, making alternative 
assumptions as to the width of the band. We found that with a band of 
candidates extending roughly from the 80th to the 40th percentile of general 
ability this theoretical pattern of results approximated very closely to that 
envisaged by the Beloe Committee, and this finding was reinforced by an 
examination of the actual pattern of results in the Northern Ireland Junior 
Certificate Examination. The figures produced for us by the Curriculum 
Study Group are included in this Report as Appendix A. 

13 . Accordingly, we are agreed that paragraph 111 of the Beloe Report 
correctly defines the scope of the examinations, and we invite the Council to 
endorse and make known to the examining boards our conclusion that the 
C.S£. system of subject examinations should be designed for a band of 
candidates extending from those v/ho just overlap the group taking the 
ordinary level of the G.C.E. examination, to those who are just below the 
average in ability. 

14 . We would emphasise, however, that this definition of the scope of the 
examinations does not necessarily define the scope of every individual syllabus 
or paper. Rather, it defines :the scope of the Certificate of Secondary Educa- 
tion considered as a system of subject examinations, and we would wish the 
examining boards and participating schools to experiment with different ways 
of covering the needs of this band of candidates, according to the varying 
curricular patterns within the schools. Nor do we intend ithat our definition 
should automatically exclude entries from candidates falling outside the band 
we have defined : we recognize that an examinations system so designed may 
nonetheless meet the needs, at least in some subjects, of a small minority of 
the pupils outside the normal C.S.E. band. And we are confident that the 
schools will not enter such pupils for C.S.E. examinations without first 
considering, with great care, whether the examination relates to a course of 
study that would be fully appropriate to the pupils concerned. 

The standards of the C.S.E. examinations 

15 . Our approach to the problem of standards was to consider where, 
within the band of candidates which we have defined as the C.S.E. baud, the 
pass/fail point would have to be placed in order to produce the pattern of 
results envisaged by the Beloe Committee. We came inescapably to the 
conclusion that dt would have to 'be so placed as to divide the perfocmances 
to be expected from pupils on or about the 50th percentile of ability. The 
theoretical pattern of results set out in Appendix A and referred to in para- 
graph 12 above would in fact place the dividing line nearer to the 40th than 
to the 50th parcentile, but this model necessarily leaves out of account a 
factor which would be likely to move the pass/fail barrier for single subject 
offerings closer to the 50th percentile of ability in the subject ; namely, the 

* The correlation between subjects is a measure of the agreement between the rankings in 
order of merit of the candidates. If all candidates had identical ranking in every subject offered 
the correlation between subjects would be TO, which represents perfect correlation. 
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certainty that many such entries will be made by candidates whose ability in 
the subject offered is higher than their general ability. The effect is to extend 
the scope of the C.S.E. examinations system (and we have already referred 
in paragraph 14 above to the need for flexibility in interpreting our definition 
of the band of candidates for whom the examination should be designed), but 
also to raise the pass/faU barrier for indmdual subjects nearer to cutting across 
the 50th percentile of ability in the subject. 

16. Nonetheless, whether we use general ability or ability in the subject as 
our criterion, it is clear that the pass /fail barrier envisaged by the Beloe 
Committee would have to be placed close to the 50th percentile, and hence 
well within that part of the band of ability for the C.S.E. system of examina- 
tions where there will be, eventually, a large number of candidates of very 
similar ability. And, for a variety of reasons, we are clear that it would be 
difficult to erect a pass/fail barrier at this point. We enumerate some of them 
below : 

(1) While it is true that the separation of performances would be assisted 
by differences between ability and achievement,* the C.S.E. border- 
line zone would stiff contain many more candidates than 'that of the 
G.C.E. examinations. It is difficult enough to take these decisions 
for ordinary level G.C.E. candidates and. once the C.S.E. examina- 
tions had been fully established, with many more pupils than at 
present remaining at school to complete a five year course of 
secondary education, the examining boards might well find themselves 
ovenvhelmed by the need to take a very large number of borderline 
decisions. 

(2) In practice, the number of borderline candidates would probably be 
somewhat reduced by the knowledge that, for pupils of average ability, 
success in the examination was highly unpredictable. This would 
discourage entries from pupils who were within the band for which 
the examinations are designed and would be, on other grounds as 
well, a most undesirable development. In particular, a reasonable 
degree of predictability of success in the C.S.E. examinations will 
be an important factor in the minds of such pupils, and of their 
parents, when deciding whether or not to stay on at school for an 
extra year. 

(3) The examination performance of pupils of average abUity is inherently 
more unpredictable than that of pupils within the G.C.E. band. 
While we hope that the examining boards will recognize this by 
introducing schemes whereby credit is given for course work, and by 
experimenting with new techniques of examining, we do not suppose 
that it will ever be possible to allow fully for the tendency of such 
pupils towards inconsistency m their examination performances. And 
we consider that it would be unfortunate if the problem were to be 
exacerbated by erecting a pass/fail barrier at the point where there 
is the greatest difficulty in distinguishrag between the quality of 
different performances. 

* The C.S.E. examinations will not test ability, except as one component of achievement, 
as measured by the examinations. Other components include the pupil’s personality, the 
quality of the teaching and the efficiency of the examinations themselves. 
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17. In these circumstances, we decided that it was necessary to reconsider 
from first principles the case for and against defining standards by a refer- 
ence to a single pass/fail point. Our approach was to examine four separate 
sets of considerations that tend to be regarded as more intimately related 
than close analysis shows to be warranted. These are: 

(1) (he “ standard ” or “ standards ” of an examination ; 

(2) the standing of an examination in the eyes of its users ; 

(3) the description of the results of an examination ; 

(4) the relationship between the results of an examination, its public 
standing, and the award of certificates. 

18. On the first of these points, we are clear that the standards of a school 
lea¥ing examination should reflect the standards of the schools. An out- 
standing examination performance should indicate that the candidate is 
outstanding, amongst the group of pupils for whom the examination is 
designed, by reference to the educational standards currently considered 
appropriate for such pupils ; and similarly, mutatis mutandis, with “ above 
average ”, “ average ” and “ below average ” performers. 

19. On the second point, we are equally clear that the standing of a school 
leaving examination ought to depend on the extent to which employers and 
others can rely on the information it provides as one means amongst others 
of weighing up whether a particular school leaver is likely to meet their 
requirements. Users of an examination have no right to expect the schools, 
or the examining boards, to define their requirements for them. But they 
have every right to expect that, once they have defined their own require- 
ments in terms of a given standard of examination perfonmance, those 
standards will be maintained with reasonable consistency. It is the dis- 
covery that the calibre of a school leaver does not measure up to the 
standard which can properly be inferred from a recorded exammatiom 
performance that ought to damage the credit of an examination rather 
than the absence of a standard defined in pass /fail terms. Indeed, a 
pass /fail standard can be damaging in itself, since it encourages users of 
the information provided by an examination to assume that someone else 
has done their job for them: and many who make this assumption are 
bound to be disappointed. 

20. On the third point, we consider that the users of an examination 
have every right to expect that its results will be described in such a way 
as to provide them with useful information about the candidates. And an 
examination that provides only the information that some candidates have 
passed, and that others have failed, will not meet the many different 
needs of the many different users of the C.S.E. examination. Within the 
band of candiidates which we have defined, some users will wish to know 
whether the Certificate describes a standard of performance which indicates 
that the candidate is of ordinary level G.C.E. calibre: others will have use- 
ful openings for candidates who are just below this standard: others will 
be looking for school leavers of average ability : and many will have hybrid 
requirements in the sense that they will be looking for evidence of a fairly 
high standard of performance in one or two subjects, but would accept a 
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lower standard in others. (This situation is not of course peculiar to the 
C.S.E. examinations. At the “ A ” level of the G.C.E. examinations, the 
Council have already agreed that the legitimate needs of the many different 
users of the results of the examinations cannot be met without giving much 
more information about the performance of candidates than was originally 
contemplated.) 

21. On the fourth point, we are agreed that policy for the award of Certifi- 
cates can be considered quite independently of the definition of standards, 
and of the way in which the results of the exiaminations are described. 
The considerations which we have examined in paragraphs 18-20 above 
lead inescapably to the conclusion that it will be necessary to define more 
than one standard in the C.S.E. examinations, and to present the results 
m such a way as to describe the different standards achieved by different 
candidates. It wUI, in other words, be necessary to move away from the 
concept of a single standard examination, and to put in its place the concept 
of a multiple definition of standards, conveyed to users of the examinations 
by means of a grading scheme. But this does not necessarily mean that 
all graded results should lead to the award of a Certificate. A pass/ fail 
barrier, defined in terms of the standard of performance held to warrant the 
issue of a Certificate of Secondary Education, could be erected on the 
dividing line between any two grades: and performances below this barrier 
could of course still be communicated by other means to the candidate and 
to his school. 

22. Accordingly, we propose to examine in the following paragraphs, first, 
the definition of standards and the ways in which results of the examinations 
might be described ; and, second, the award of Certificates and the related 
question of the standing of the C.S.E. examinations. 

The Definition of Standards 

23. The definition of standards, within an examinations system that must 
define more than one standard of achievement, is best considered wi thin the 
context of the grading scheme which it is proposed to use to ccmvey informa- 
tion on standards of achievement to users of the results of the examination. 
We therefore asked the Curriculum Study Group to suggest for our con- 
sideration a possible grading scheme, so that we could have a firm basis 
for discussion. 

24. The scheme suggested to us, modified in the light of our discussions, is 
described in Appendix B to this report. It has five grades, two of which 
are reference grades for the definition of standards, one near the top and 
one near the bottom of the scale. 

25. We agree that it is not necessary to define the standard of each grade, and 
that two reference grades are sufiioient: the standards of the other grades 
can be inferred, and described with reasonable accuracy. We therefore con- 
sidered what choice of reference grades we should recommend, and how 
they should be defined. We also considered how many other grades tlie 
scale might contain. 

8 



Printed image digitised by the University of Southampton Library Digitisation Unit 



26. We quickly concluded that the main reference grade would have to be 
placed near the bottom of the scale, and should define the standard of per- 
formance to be expected from a sixteen year old pupil of average ability in 
the subject, who has applied himself to a course of study regarded by 
teachers of the subject as appropriate to his age. ability and aptitude. Such 
pupils are squarely within the scope of the C.S.E. examinations system, as 
generally agreed, and we are clear that this standard of achievement should 
result in the award of a Certificate, whatever decisions are taken about the 
future of the pass/fail concept or about the grading scheme as a whole. 

27. We must, however, make it clear what we mean by a pupil of average 
ability in the subject, since it will be apparent from Diagram 1 and from 
what we have said in paragraphs 15-16 above that this is. in itself, a diffi- 
cult concept. In the first place, we must emphasise that we have in mind 
the average of the whole ability range: we do not mean the average of the 
C.S.E. band of candidates, nor the average within any particular school 
or local group of schools. Second, we have m mind a band of pupils, 
and not some hypothetical pupil whose ability can be said to be precisely 
average. We are, in eSect, inviting the teachers to formulate a coEective 
judgment as to the standard of achievement which, in their view denotes 
the successful completion of a five year course of study by pupils who are 
about average in ability. We are not suggesting that it is possible, and stiU 
less that it is desirable, to formulate a standard precisely aimed at the 50th 
percentile of ability in the subject. We do not want a sharp cut-off in the 
middle of the considerable group of pupils of very similar ability who sur- 
round the 50th percentile, nor would it be reasonable to expect the 
teachers to formulate a standard with this degree of precision. But all 
teachers are accustomed to fonning judgments as to which of their pupils 
should be included in the sizeable group which can best be described as 
about average in ability, and all teachers have in mind a standard of achieve- 
ment which ought to he within the reach of any pupil in this group who 
applies himself to an appropriate course of study. This is the standard 
which we have in mind, and what we are asking the teachers to do is 
to compare their 'individual judgments on this standard of achievement with 
a view to minimising differences between teachers, and between schools, and 
so arrive at an evaluation of the standard that is generally agreed. In a 
sense, therefore, our definition is not a definition at all: it is rather a 
description of the character of the collective judgment which we are asking 
the teachers to make, in discharge of their own responsibility for the stan- 
dards of the work which they expect in the schools. 

28. We found more difficulty in deciding upon an upper reference grade. We 
saw at once the advantage of making apparent the overlap, in terms of the 
calibre of the candidates, between the C.S.E. and the G.C.E. examinations. 
We hope that professional bodies, and ofhers who now make use of the 
ordinary level of the G.C.E. as a qualifying exammation, will recognise 
the overlap and 'be prepared to make use of the C.S.E. examinations as 
alternative evidence of the qualities they are seeking. This development 
would be of 'great help to the schools, who will otherwise have to make 
difficult choices in borderline cases between G.C.E. and C.S.E. courses, and 
will have to provide consecutive courses leading to both examinations for 
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the benefit of pupils who raise their sights after ofotaming a high grade in 
the C.S.E. Moreover, it is dear that a development along these lines must 
be expected : we have already received enquiries from bodies who wish to 
use the C.S.E. examinations in this way. 

29. But we also recognise that this development involves risk. The overlap 
which we would like to make apparent is an overlap in the calibre of the 
candidates : it is not an overlap in the content of the syllabus, in examination 
papers or in examining techniques. Nor do we contemplate for one moment 
that an ordinary level G.CE. certificate should be issued on the basis of a 
high grade in the C.S.E. examinaition. Both examination systems must 
develop along their own lines, according to the needs of the majority of 
the pupils for whom they are designed. And if the alternative use of the 
two types of certificate which we have in mind could be bought only at the 
cost of equivalence of syllabus content, papers, or of examining techniques, 
we could not agree to pay so high a price. 

30. Techniques are however available which will enable the examining 
boards, and the Council, to validate a grade of performance in the C.S.E. 
examination as being that of a candidate of ordinary level G.C.E. calibre, 
and which do not require the alignment or detailed comparison of G.C.E. and 
C.S.E. syllabuses, papers or scripts. We are satisfied that the use of these 
techniques will not involve turning the C.S.E. examinations into a pale 
imitation of those for the G.C.E., and we therefore recommend that the 
second reference grade should be defined as follows : 

“ In each subject, the examination should be so constructed that a 
sixteen year old pupil whose ability in ;the subject is such that he 
might reasonably have secttred a pass in the ordinary level of the G.CE. 
examination, had he applied himself to a course of study leading to 
that examination, may reasonably expect to secure Grade I in the 
C.S.E. examination having appEed himself to a course of study regarded 
by teachers of ithe subject as appropriate to 'his age, ability and 
aptitude.” 

31. We turn now to a consideration of the other grades described in 
Appendix B. The grading scheme originally suggested to us proposed that 
candidates who are of ordinary 'level G.C.E. calibre should 'be allocated to 
two grades, one of which iwas the upper reference grade and the other a 
grade describing an even higher standard of performance. The case for 
two grades at the 'top rests on the best guess that can 'be made as to the 
proportion of the subject entries that 'can be expected to overlap the 
G.C.E. band of performances. The Curriculum Study Group think that 
this proportion may well be as high as 15 per cent., though they emphasise 
that this is no more than a guess. Assuming, however, that the figure is 
correct, there is evidence which suggests ithat psychologic^ factors may 
inhibit examiners from placing in a single top grade as many as 15 per 
cent, of the entries : it is therefore argued that it would 'be better to have 
two grades at the top in order to minimise the risk of under-grading 
performances that are in fact of ordinary level G.C.E. standard. 

32. Against this, it can be argued 'that it would ‘be anomalous to have two 
grades at this level of 'performance 'in the C.S.E. examinations when there 
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are no grades at the ordinary level of the G.C.E. Moreover, the techniques 
for validating standards which we have already mentioned in paragraph 30 
of this Report should, in :time, enable the examining boards to correct any 
tendency towards under-grading the best performance. On balance, we 
consider that the right course would be to launch the C.S.E. examinations 
on the basis that the overlap with the ordinary level of the G.C.E. examina- 
tion will be covered by only one grade: the possibility of introducing two 
grades at the top can be reconsidered later on, in 'the light of experience. 

33. The grading scheme proposed 'to us also suggested that 'there should be 
two grades to describe 'performances failing tetween the standards of the 
two reference grades. It is argued that 'this is necessary in order to provide 
information 'to employers and others about performances covering a wide 
baud, extending from those who are on the borderline of the G.C.E. group 
to 'those who are close to the average in ability. This is a strong argument, 
since we have evidence that some employers who use the ordinary level 
of the G.C.E. as an entry qualification are much concerned about the loss 
of useful talent Which results from lack of information about borderline 
performances. They would, in some cases, be happy to extend their field 
of recruitment 'below ithat of an ordinary 'level G.C.E. pass provided that 
they could be 'Satisfied that the extension was not too great. In terms of 
Appendix B they would, 'in other words, 'like 'to make use of a grade 2 that 
described a performance just 'bdlow ordinary level G.C.E. calibre, but 
would find it difficult .to make use of a grade that gave them no infonnation 
between the G.C.E. borderline and .the average in ability. 

34. Against 'this, it 'must be admitted 'that it will be necessary to rely heavily 
on statistical methods iu order to separate performances wi thin this band ; 
the scope for conscious decisions on 'the pant of the examiners is inevitably 
limited. Moreover, 'all divisions of 'performances, 'however made, involve 
some injustice. Nonetheless, we are inclined to think that there will be less 
injustice if this band is divided than if it is covered 'by a single grade, and 
we therefore recommend ithat this proposal should be endorsed. 

35. We are also satisfied 'that 'there is a good case for the grade described in 
Appendix B as grade 5. In the main, pupils who secure this grade will 
be those of 'average ability in the subject who have been correctly entered, 
since 'they were -properly following courses within ttihe scope of the C.S.E. 
examination, but whose examination performances were not quite up to the 
standard of grade 4 . Information about these performances wifi be valuable 
to the schools, and to the candidates themselves : and we have already said 
that we are impressed by the evidence we have received that many em- 
ployers would like more information about performances on the borderline 
of an examination system, for use in conjunction with other assessments 
(including their own) of a school leaver’s calibre and potentialities. 

36. There remains the question how best to describe the performances of 
candidates who, on the evidence of the examinations, fall outside the group 
for which 'the C.S.E. is designed. One possibility would be to extend the 
grading scheme to describe such performances, but this solution would be 
open to a number of objections. In paiiticular, the existence of a number 
of grades -below .the grade described -iu Appendix B as grade 5 mi^t suggest 
a major extension of the scope of -the examinaitians, whereas the only 
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solution that is within our terms of reference is one which would define 
performances which are “out of scope”. Accordingly, we agree that these 
performances should be classified as ungraded. We hope, however, that 
there will be very few candidates in this category. Indeed, we are firmly 
of the opinion that any school which finds that more than 10 per cent, of 
its subject entries receive ungraded classifications will need to consider very 
carefully whether its examinations policy is soundly based. 

The Award of Certificates 

37. If the Council endorse 'the recommendations made above, the standards 
of the C.S.E. examinations will be defined and described by means of five 
grades, including two reference grades at Which conscious decisions on 
standards will need to be made. There will also be a sbatih category of 
result, classified as ungraded ; this classification Will describe those perform- 
ances which suggest that the candidate has been following a course, or has 
taken an examination, not designed to meet 'his or her needs. 

38. The one outstanding question is policy for the award of Certificates of 
Secondary Education. Should these be issued to all candidates who obtain 
one of the five grades that describe performances falling within the scope 
of the C.S.E. examinations system, or should there be a pass/faU barrier 
which denies a Certificate to some of these candidates? In practice, the 
question can be posed even more simply : should Certificates be issued on 
the basis of grade 5 performances, or should such performances be com- 
municated by other means to the candidate and his school, in much the 
same way as we envisage for ungraded results? We have already made 
clear our view that grade 4 performances should certainly lead to the 
award of a Certificate. 

39. There are strong arguments both for and against awarding Certificates 
on the strength of grade 5 results. The main ones in favour are as 
follows ; 

(1) The pass/faU concept of school leaving examinations is becoming 
increasingly inappropriate. As these examinations are now to cater 
for a wide range of ability, and as the many different users of the 
results are interested in many different standards of achievement, it 
is becoming urgent to substitute a new concept of examinations as 
primarily a source of information about some of the qualities of the 
candidates, which users of the resul-ts must evaluate according to 
their own requirements, in conjunction with other evidence. 

(2) If this is so, there is no need to import unnecessary emotional over- 
tones into the description of examination results, and to reinforce 
the injustice which is unavoidable whenever performances have to 
be categorised, by describing some candidates as failures. Some 
wifi not be failures at all, but simply unlucky in having been under- 
graded : it is unlikely that the C.S.E. examinations will achieve any 
greater accuracy than + 5 per cant, in ranking the order of perform- 
ances. Indeed, it is difficult to see how any candidate who obtains 
grade 5 can properly be described as a failure since, by definition, 
this standard of performance is within the scope of the C.S.E. exami- 
nations system : it is no more and no less than the lowest standard 
of achievement which the system is designed to test. 
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(3) The margin of error in grading performances is likely to be some- 
what higher than ± 5 per cent, at the borderline between grades 
4 and 5, for the reasons given in paragraphs 15-16 of this Report. 
The performances of candidates who are close to the average in ability 
are the most difficult to grade accurately, and this reinforces the case 
for being as unemotional as possible in the descriptions attached to 
such gradings, and for avoiding situations in which evidence obtained 
at this point in the ranking order is given more weight than it ought 
to have. 

(4) The establishment of a new system of school-leaving examinations 
provides a unique opportunity for breaking with traditional practice. 

40 . The main arguments against awarding Certificates on the basis of grade 5 
performances are as follows : 

(1) While it is true that the public standing of a school leaving exami- 
nation ought to depend on the considerations advanced in para- 
graph 19 above, this is not yet generally accepted. In the minds of 
most people — pupils, parents, teachers and employers — standards, 
standing and the pass/fail barrier are still closely linked concepts. 
It is widely held that an examination cannot have standing unless 
its standards are set high enough to “ mean something ” ; and it is 
also widely held that the only way to define such a standard is to 
erect a pass/fail barrier. 

(2) It would therefore be damaging to the standing of the C.S.E. exami- 
nations if, from the outset. Certificates were to be awarded on the 
basis of performances which many people would regard as of too 
low a standard to merit such treatment, and which were thought to 
be of a lower standard than that contemplated by the Beloe 
Committee. 

(3) Any move away from the pass/fail concept should therefore be 
deferred until public opinion has been better prepared to accept 
and understand the need for a new concept of school leavmg 
examinations. 

(4) When the time comes to make this move, it should apply to the 
G.C.E. as well as to the C.S.E. examinations. The pass/faU con- 
cept may be strengthened, if it is retained for the older examinations 
system alone, since the mistaken idea may gain ground that it has 
been dropped from the C.S.E. system because “ these examinations 
do not matter so much ”. 

41 . We would emphasise that all that is at issue is a limited move away from 
the pass/fail concept. Since the scope of the C.S.E examinations is restricted 
to a limited range of courses, and of candidates following such courses, the 
dividing line between grade 5 and the ungraded category of performances 
must, for all practical purposes, operate as a pass/faU barrier. 

42 . There are in fact three possibilities : 

(1) To award Certificates to all candidates who secure at least one grade 
in the range 1-5. 
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(2) To award Certificates only to those candidates who secure at least 
one grade in the range 1-4, but to record grade 5 performances on 
the Certificates where they are issued. 

(3) To award Certificates only to those candidates who secure at least 
one grade in the range 1^, and to treat grade 5 performances in the 
same way as ungraded results (i.e. they would be officially com- 
municated to the candidate and to his school, but not recorded on 
Certificates). 

Our own view, which we invite the Council to endorse, is that the second of 
these possibilities provides a reasonable compromise basis on which to launch 
the Certificate of Secondary Education examinations. 

43 . We would add, however, tliat policy on the award of Certificates need 
not be finally decided until the early months of 1965, and we therefore recom- 
mend that before making this recommendation binding upon the examining 
boards the Council should invite comments on the arguments put forward in 
this report. We also suggest that this might be one of the matters that could 
usefully be discussed at a series of regional conferences which, if the Council 
agree, we should like to arrange in association with the examining boards 
in the course of the 1963-64 school year. We would hope that these might 
be widely attended by the teachers concerned with the conduct of the exami- 
nations, and by representatives of the local education authorities and of 
commerce and industry ; and that the agenda might include, in addition to 
this report, the pamphlet of suggestions for teachers and examiners now 
being prepared, and a discussion of the respective responsibilities of the 
examining boards and of the Council. 

Proposals for action 

44 . We invite the Council to endorse as firm Council policy our conclusions 
that : 

(1) the C.S.E. system of examinations should be designed for a band of 
candidates extending from those who just overlap the group taking 
the ordinary level of the G.C.E. examination, to those who are just 
below the average in ability ; (paragraph 13) 

(2) the above definition of the scope of the examinations should not, 
however, be interpreted too rigorously. There will be some pupils 
whose ability in a particular subject would justify their entering 
for the examination, although their general ability falls outside the 
band we have defined. And the converse is equally true ; some 
pupils whose general ability is within the band we have defined 
would be ill-advised to enter for some subjects ; (paragraph 14) 

(3) within the grading scheme for the presentation of results described 
in Appendix B, there will be two reference grades for the definition 
of standards ; (paragraph 24) 

(4) the definition of standards will therefore te as follows : 

“ In each subject, the examination should be so constructed that : 

(i) a sixteen year old pupil of average ability who has applied 
himself to a course of study regarded by teachers of the subject 
as appropriate to his age, ability and aptitude, may reasonably 
expect to secure grade 4 ; and 
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(ii) a sixteen year old pupil whose abiUty is such that he might 
reasonably have seour^ a pass in the ‘ O ’ level of the G.C.E. 
examination, had he applied liimseh to a course of study leading 
to that examination, may reasonably expect to secure grade 1, 
having followed a course of study defined as in (i) above.” 
(paragraphs 26 and 30) 

(5) Certificates of Secondary Education should be awarded only to those 
candidates who secure at least one grade in the range 1-4 ; (para- 
graph 42) 

(6) Where Certificates are issued, they will also record grade 5 perform- 
ances ; (paragraph 42) 

(7) Other grade 5 performances, and all ungraded results, will be 
officially commurticated to the candidate and to his school, but will 
not be recorded on Certificates, (paragraphs 36 and 42) 

45. Finally, we recommend that the Council should ask the Minister of 
Education to communicate conclusions (l)-(4) above to the examining boards, 
in amplification of the appropriate conditions of recognition, and to invite 
comments on recommendations (5)-(7) before they are similarly made bind- 
ing upon the examining boards. 
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APPENDIX A 



I. A theoretical model 

The percentage of the population capable of passing an examination in a 
number of subjects will differ from the percentage capable of passing in one 
subject. The difference will depend upon the amount of correlation between 
subjects. To construct a theoretical model it is necessary to assume a 
value for .the average correlation between subjects when a cross-section of 
the population is examined. There is little or no evidence available for 
the Beloe age group since a complete cross-section of the population is 
rarely examined or tested. However authorities consulted agree that a 
reasonable estimate of this average correlation between subjects would be 
0-8. This estimate is based mainly upon correlations between tests and 
examinations at 11 + . It is likely to he too high rather than too low. 

In Table 1 percentages of the population for various combinations of 
subjects are given, assuming that the percentage capable of passing in any 
one subject is (a) 60 per cent. ; (i) 50 per cent. These correspond to (a) the 
40th percentile and (b) the 50th peroentUe of the normal distribution curve 
of general ability. 



Table No. 1 

Percentages of Population Passing in Various Combinations of Subjects 
Average Correlation = 0-8 



i 

i Per 


Per cent passing in 


Per cent passing in at least 






cent 

pass- 

ing 

one 

subject 


Two 
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of 

two 
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three 


Four 
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of 

four 


Five 
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of 

five 


One 

out 

of 

two 
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of 

three 
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of 

four 


Four 
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of 

five 


Five 

out 

of 

six 


One 

out 

of 

three 


Two 

out 

of 

four 


Three 

out 

of 

five 


Four 

out 

of 

six 


Five 

out 

of 

seven 


Co) 


60 


50 


43-5 


39 


36 


70 


54-5 


47 


41-5 


38 


75 


56-5 


48 


42-5 


38-5 


(6) ... 


50 


40 


34 


30 


26 


60 


44 


36-5 


31-5 


28 


66 


46 


38 


33 


29 



The above figures suggest that a near approximation to the Beloe formula 
would be obtained by allowing between 50 per cent, and 60 per cent, of 
tbe population to pass in individual subjects, or, in other words, by defining 
the pass/fail standard in terms of .the standard of performance to be 
expected between the 50th and the 40th percentile of general ability. 

II. Actual Results 

In Table No. 2 the percentage passes in a recent Northern Ireland Junior 
Certificate examination for various combinations of subjects are shown. It 
is important to realise that these results are percentages of the sample not 
of the whole population. 

Table No. 2 



Percentage Passes* in Various Combinations of Subjects in the Northern Ireland 
Junior Certificate Examination 



Per cent passing 
in one subject 


Per cent passing in 


Per cent passing in 


Four 
out of 
four 


Five 
out of 
five 


Four 
out of 
five 


Four 
out of 
six 


Five 
out of 
six 


Five 
out of 
seven 


74 


49-5 


46 


64-5 


71*5 


61 


67 


58 


32 


29 


45 


53 


42 


49 


42 


15-5 


13 


27-5 


35 


24-5 


30 



* In order to show the pattern of results that would result from passing different propor- 
tions of the entry in only one subject, three different pass marks were assumed. 
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It is not suggested that the Northern Ireland examination is similar to 
the proposed C.S.E. examination. But the results are valuable as a check on 
the theoretical model since they refer to real candidates. The same trend 
occurs in both the theoretical model and the actual Northern Ireland 
results. 
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APPENDIX B 



A Grading Scheme for the C.S.E. Examinations 

1. Within the five point scale there would be 'two reference grades, one 
at grade 1 and the other at grade 4, defined as in paragraph 44 (4) of this 
Report. Exani'iners would allocate candidates to these two grades on merit, 
making conscious decisions on the basis of all the available evidence. 

2. All candidates between grades 1 and 4 would be allocated to grades 2 
and 3 in equal numbers, subject to ilhe decision of the examiners in borderline 
cases. 

3. Grade 5 would be used to describe performances which, while not of 
grade 4 standard, nonetheless had enough merit to show that the candidate 
had been properly entered for the examination. (At some stage the examining 
boards may need more detailed guidance on allocations to grade 5, but the 
above is likely to prove adequate while the number of candidates in the 
lower grades is small.) 

4. All performances inferior to those placed in grade 5 would be classified 
as ungraded. 

Issue of certificates 

5. All candidates would receive a notification of the grades obtained in all 
subjects offered, including ungraded classifications : these documents would 
contain a brief explanation of the meaning of the grades, and a statement 
'to the efiect that the document was not a Certificate of Secondary Education. 

6. Certificates of Secondary Education would be issued to those candidates 
who had secured at least one grade in the range 1-4 inclusive ; where 
issued, they would also record grade 5 results. 

7. Other grade 5 results would be treated in the same way as ungraded 
classifications. 

8. A brief explanation of the meaning of the grades would also be printed 
on the back of all certificates. 
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